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Abstract 


Standard  game  theory  assumes  that  the  structure  of  the  game  is  common  knowledge  among 
players.  We  relax  this  assumption  by  considering  extensive  games  where  agents  may  be  unaware  of 
the  complete  structure  of  the  game.  In  particular,  they  may  not  be  aware  of  moves  that  they  and  other 
agents  can  make.  We  show  how  such  games  can  be  represented;  the  key  idea  is  to  describe  the  game 
from  the  point  of  view  of  every  agent  at  every  node  of  the  game  tree.  We  provide  a  generalization 
of  Nash  equilibrium  and  show  that  every  game  with  awareness  has  a  generalized  Nash  equilibrium. 
Finally,  we  extend  these  results  to  games  with  awareness  of  unawareness,  where  a  player  i  may  be 
aware  that  a  player  j  can  make  moves  that  i  is  not  aware  of,  and  to  subjective  games,  where  payers 
may  have  no  common  knowledge  regarding  the  actual  game  and  their  beliefs  are  incompatible  with 
a  common  prior. 

keywords:  Economic  Theory,  Foundations  of  Game  Theory,  Awareness,  Solution  Concepts. 

1  Introduction 

Standard  game  theory  models  implicitly  assume  that  all  significant  aspects  of  the  game  (payoffs,  moves 
available,  etc.)  are  common  knowledge  among  the  players.  While  such  common  knowledge  may  seem 
unreasonable,  there  are  well-known  techniques  going  back  to  Harsanyi  [12]  for  transforming  a  game 
where  some  aspects  are  not  common  knowledge  to  one  where  they  are  common  knowledge.  All  these 
techniques  assume  that  players  are  at  least  aware  of  all  possible  moves  in  the  game.  However,  this  is 
not  always  a  reasonable  assumption.  For  example,  sleazy  companies  assume  that  consumers  arc  not 
aware  that  they  can  lodge  complaints  if  there  arc  problems;  in  a  w  ar  setting,  having  technology  that  an 
enemy  is  unaw  are  of  (and  thus  being  able  to  make  moves  that  the  enemy  is  unaw  are  of)  can  be  critical; 
in  financial  markets,  some  investors  may  not  be  aw  are  of  certain  investment  strategies  (complicated 
hedging  strategies,  for  example,  or  tax-avoidance  strategies). 
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In  a  standard  game,  a  set  of  strategies  is  a  Nash  equilibrium  if  each  agent’s  strategy  is  a  best  re¬ 
sponse  to  the  other  agents’  strategies,  so  each  agent  i  would  continue  playing  its  strategy  even  if  i  knew 
what  strategies  the  other  agents  were  using.  To  understand  the  relevance  of  adding  the  possibility  of 
unawareness  to  the  analysis  of  games,  consider  the  game  shown  in  Figure  1.  One  Nash  equilibrium  of 
this  game  has  A  playing  across^  and  B  playing  down  //.  However,  suppose  that  A  is  not  aware  that  B 
can  play  down/-;.  In  that  case,  if  A  is  rational,  A  will  play  down  /.  Therefore,  Nash  equilibrium  does 
not  seem  to  be  the  appropriate  solution  concept  here.  Although  A  would  play  across^  if  A  knew  that  B 
were  going  to  play  down//,  A  cannot  even  contemplate  this  possibility,  let  alone  know  it. 


across^  across* 


04)  (2,3) 

Figure  1 :  A  simple  game. 


Our  goal  is  to  find  appropriate  solution  concepts  for  extensive  games  with  possibly  unaw  are  players, 
and  more  generally,  to  find  ways  of  representing  multiagent  systems  where  some  agents  may  not  be 
aware  of  features  of  the  system.  To  do  this,  we  must  first  find  an  appropriate  representation  for  such 
games.  The  first  step  in  doing  so  is  to  explicitly  represent  what  players  arc  aware  of  at  each  node.  We  do 
this  by  using  what  we  call  an  augmented  game.  An  augmented  game  describes  how  awareness  changes 
over  time.  For  example,  perhaps  A  playing  across./  will  result  in  B  becoming  aware  of  the  possibility 
of  playing  down//.  In  financial  settings,  one  effect  of  players  using  certain  investment  strategies  is  that 
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other  players  become  aware  of  the  possibility  of  using  that  strategy.  Strategic  thinking  in  such  games 


must  involve  taking  this  possibility  into  account. 

We  cannot  in  general  represent  what  is  going  on  using  only  one  augmented  game.  The  standard 
representation  of  a  game  implicitly  assumes  that  (it  is  common  knowledge  that)  the  modeler  and  the 
players  all  understand  the  game  the  same  way.  This  is  no  longer  true  once  we  allow  for  the  possibility  of 
unawareness,  since  a  player’s  description  of  the  game  can  now  involve  only  those  aspects  of  the  game 
that  he  is  aware  of.  Thus,  the  full  description  of  the  game  with  awareness  is  given  by  a  set  of  augmented 
games,  one  for  the  modeler  and  one  for  each  game  that  at  least  one  of  the  agents  thinks  might  be  the 
true  game  in  some  situation. 

Continuing  with  the  game  in  Figure  1,  the  augmented  game  from  the  point  of  view  of  the  type  of  B 
that  is  unaware  of  the  possibility  of  playing  down #  would  just  include  .4’s  moves  down. 4  and  across^ 
and  the  move  across#.  In  that  augmented  game,  player  A  is  also  unaware  of  the  move  down  #.  By  way 
of  contrast,  the  augmented  game  from  the  point  of  view  of  the  type  of  B  that  is  aware  of  down #  would 
include  the  move  down#,  but  may  also  allow  for  the  possibility  that  A  is  not  aware  that  B  is  aware  of 
this  move. 

The  standard  notion  of  Nash  equilibrium  consists  of  a  collection  of  strategies,  one  for  each  player. 
Our  generalization  consists  of  a  collection  of  strategics,  one  for  each  pair  (i,  T7),  where  F7  is  a  game 
that  agent  i  considers  to  be  the  true  game  in  some  situation.  Intuitively,  the  strategy  for  a  player  i  at  T' 
is  the  strategy  i  would  play  in  situations  where  i  believes  that  the  true  game  is  T7.  To  understand  why 
we  may  need  to  consider  different  strategies  consider,  for  example,  the  game  of  Figure  1.  B  would  play 
differently  depending  on  whether  or  not  he  was  aware  of  down#.  Roughly  speaking,  a  set  of  strategies, 
one  for  each  pair  (i,  F7),  is  a  generalized  Nash  equilibrium  if  the  strategy  for  it.  F')  is  a  best  response 
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for  player  i  if  the  true  game  is  T' ,  given  the  strategics  being  used  by  the  other  players  in  \  ' . 

We  argue  that  this  notion  of  equilibrium  correctly  captures  our  intuitions.  We  then  show  that  every 
game  with  awareness  has  a  generalized  Nash  equilibrium  by  associating  with  a  game  with  awareness 
a  standard  game  (where  agents  arc  aware  of  all  moves)  such  that  there  is  a  one-to-one  correspondence 
between  generalized  Nash  equilibria  of  the  game  with  awareness  and  Nash  equilibria  of  the  standard 
game. 

For  ease  of  exposition,  for  most  of  the  paper  we  focus  on  games  where  agents  arc  not  aware  of 
their  lack  of  awareness.  That  is,  we  do  not  consider  games  where  one  player  might  be  aware  that  there 
arc  moves  that  another  player  (or  even  she  herself)  might  be  able  to  make,  although  she  is  not  aware 
of  what  they  arc.  Such  awareness  of  unawareness  can  be  quite  relevant  in  practice.  For  example,  in 
the  war  setting  described  above,  even  if  one  side  cannot  conceive  of  a  new  technology  available  to  the 
enemy,  they  might  believe  that  there  is  some  move  available  to  the  enemy  without  understanding  what 
that  particular  move  is.  This,  in  turn,  may  encourage  peace  overtures.  To  take  another  example,  an 
agent  might  delay  making  a  decision  because  she  considers  it  possible  that  she  might  learn  about  more 
possible  moves,  even  if  she  is  not  aware  of  what  these  moves  arc. 

If  we  interpret  “lack  of  awareness”  as  “unable  to  compute”  (cf.  [2]),  then  awareness  of  unawareness 
becomes  even  more  significant.  Consider  a  chess  game.  Although  all  players  understand  in  principle 
all  the  moves  that  can  be  made,  they  arc  certainly  not  aware  of  all  consequences  of  all  moves.  A  more 
accurate  representation  of  chess  would  model  this  computational  unawareness  explicitly.  We  provide 
such  a  representation. 

Roughly  speaking,  we  capture  the  fact  that  player  i  is  aware  that,  at  a  node  h  in  the  game  tree, 
there  is  a  move  that  j  can  make  she  (i)  is  not  aware  by  having  V s  subjective  representation  of  the  game 
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include  a  “virtual”  move  for  j  at  node  h.  Since  i  might  have  only  an  incomplete  understanding  of  what 
can  happen  after  this  move, 

i  simply  describes  what  she  believes  will  be  the  game  after  the  virtual  move,  to  the  extent  that  she 
can.  For  example,  if  she  has  no  idea  what  will  happen  after  the  virtual  move,  then  she  can  describe  her 
beliefs  regarding  the  payoffs  of  the  game.  Thus,  our  representation  can  be  viewed  as  a  generalization 
of  how  chess  programs  analyze  chess  games.  They  explore  the  game  tree  up  to  a  certain  point,  and  then 
evaluate  the  hoard  position  at  that  point.  We  can  think  of  the  payoffs  following  a  virtual  move  by  j  in 
V s  subjective  representation  of  a  chess  game  as  describing  the  evaluation  of  the  hoard  from  V s  point  of 
view.  This  seems  like  a  much  more  reasonable  representation  of  the  game  than  the  standard  complete 
game  tree ! 

Our  framework  is  flexible  enough  to  deal  with  games  where  there  is  lack  of  common  knowledge 
about  what  is  the  game  being  played.  In  particular,  we  can  deal  with  lack  of  common  knowledge  re¬ 
garding  the  utilities,  who  moves  next,  the  structure  of  other  players’  information  sets,  and  the  probability 
of  nature’s  moves  (even  in  cases  where  there  is  no  common  prior  compatible  with  the  players’  beliefs 
regarding  nature). 

Recently,  Feinberg  [3,  4]  also  studied  games  with  awareness.  Feinberg  [4]  gives  a  definition  of 
extended  Nash  equilibrium  in  normal-form  games.  Although  his  definition  stems  from  much  the  same 
intuitions  as  ours  (although  some  details  arc  different — see  Section  6),  it  is  expressed  syntactically. 
Each  player  is  characterized  by  a  complete  description  of  what  moves  and  players  he  is  aware  of,  what 
moves  and  players  he  is  aware  that  each  other  player  is  aware  of,  and  so  on  through  all  levels  of  iterated 
awareness.  Feinberg  [3]  deals  with  extensive-form  games  and  defines  solution  concepts  only  indirectly, 
via  a  syntactic  epistemic  characterization.  His  approach  lacks  a  more  direct  semantic  framework,  which 
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our  model  provides.  He  also  does  not  deal  with  awareness  of  unawareness. 


The  rest  of  this  paper  is  organized  as  follows.  In  Section  2,  we  describe  how  we  represent  different 
awareness  levels  in  a  game.  In  Section  3,  we  use  our  representation  to  define  a  generalized  notion  of 
Nash  equilibrium,  and  we  prove  its  existence  in  games  with  awareness.  In  Section  4,  we  describe  how 
we  can  extend  our  approach  to  deal  with  awareness  of  unaware  ness.  In  Section  5,  we  describe  how  to 
extend  our  framework  to  deal  with  games  where  there  is  lack  of  common  knowledge,  even  if  aw  areness 
is  not  an  issue.  We  compare  our  work  to  others  in  the  literature,  particularly  Feinberg’s,  in  Section  6, 
and  conclude  in  Section  7. 

2  Modeling  awareness 

The  first  step  in  dealing  with  awareness  is  modeling  it.  To  this  end,  we  consider  augmented  games.  We 
start  with  a  standard  game,  described  by  a  game  tree  T  (as  in  Figure  1).  An  augmented  game  T4  based 
on  T  essentially  augments  l  by  describing  each  agent’s  awareness  level  at  each  node,  where  player  i’s 
aw  areness  level  at  a  node  h  is  essentially  the  set  of  runs  (complete  histories)  in  F  that  i  is  aw  are  of  at 
node  h.  A  player’s  aw  areness  level  may  change  over  time,  as  the  player  becomes  aw  are  of  more  moves. 

Our  formal  definition  of  augmented  game  is  based  on  the  definition  of  extensive  game  given  by 
Osborne  and  Rubinstein  [22].  We  start  by  briefly  reviewing  Osborne  and  Rubinstein’s  definition. 

A  ( finite )  extensive  game  is  a  tuple  ( N ,  M,  H,  P ,  fc,  {I,  :  i  G  N},  {ui  :  i  G  N}),  where 

•  N  is  a  finite  set  consisting  of  the  players  of  the  game. 

•  M  is  a  finite  set  whose  elements  are  the  moves  (or  actions)  available  to  players  (and  nature)  during 
the  game.1 

1Osborne  and  Rubinstein  did  not  make  M  explicit  in  their  definition  of  an  extensive  game;  we  find  it  convenient  to  make 
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•  H  is  a  finite  set  of  finite  sequences  of  moves  (elements  of  M )  that  is  closed  under  prefixes,  so  that 
if  h  E  II  and  h'  is  a  prefix  of  H,  then  b!  €  H.  Intuitively,  each  member  of  H  is  a  history.  We 
can  identify  the  nodes  in  a  game  tree  with  the  histories  in  H.  Each  node  n  is  characterized  by  the 
sequence  of  moves  needed  to  reach  n.  A  run  in  If  is  a  terminal  history,  one  that  is  not  a  strict  prefix 
of  any  other  history  in  H.  Let  Z  denote  the  set  of  runs  of  H.  Let  My,  =  {rn  E  M  :  h  ■  (m)  E  II } 
(where  we  use  •  to  denote  concatenation  of  sequences);  My,  is  the  set  of  moves  that  can  be  made 
after  history  h. 

•  P  :  ( II  —  Z)  — >  N  U  {c}  is  a  function  that  assigns  to  each  nonterminal  history  h  a  member  of 
ArU  {c}.  (We  can  think  of  c  as  representing  nature.)  If  P(h)  =  i,  then  player  i  moves  after  history 
h;  if  P(h)  =  c,  then  nature  moves  after  h.  Let  H ,  =  {h  :  P(h)  =  i  \  be  the  set  of  all  histories 
after  which  player  i  moves. 

•  fc  is  a  function  that  associates  with  every  history  for  which  P(h)  =  c  a  probability  measure 
fc(-  |  h)  on  My j.  Intuitively,  fc(-  \  h )  describes  the  probability  of  nature’s  moves  once  history  h 
is  reached. 

•  Zi  is  a  partition  of  H,  with  the  property  that  if  h  and  h'  are  in  the  same  cell  of  the  partition  then 
Mh  =  Mv,  i.e.,  the  same  set  of  moves  is  available  at  every  history  in  a  cell  of  the  partition. 
Intuitively,  if  h  and  h'  are  in  the  same  cell  of  Z,,  then  h  and  h'  are  indistinguishable  from  V s  point 
of  view;  i  considers  history  h!  possible  if  the  actual  history  is  h,  and  vice  versa.  A  cell  I  E  Z,  is 
called  an  (■ i-)information  set. 

•  uy  :  Z  — >  R  is  a  payoff  function  for  player  i,  assigning  a  real  number  (i’s  payoff)  to  each  run  of 
the  game. 


it  explicit  here. 


In  the  game  of  Figure  1, 


•  N  =  {A,B},  H  =  {(),  (down^),  (across^, down#),  (acrossA,  across#)}, 

•  P({ ))  =  A,  P(( acrossA))  =  B, 

•  I  A  =  {(>},  Ib  =  {(acrossA)}, 

•  «A((d«wnA))  =  itB((downA))  =  1, 

•  ua ((across a,  across#))  =  0,  and 

•  (acrossA,  across#))  =  2. 

In  this  paper,  as  in  most  work  in  game  theory,  we  further  assume  that  players  have  perfect  recall : 
they  remember  all  the  actions  that  they  have  performed  and  the  information  sets  they  passed  through. 
Formally,  we  require  that 

•  if  h  and  h!  are  in  the  same  /'-information  set  and  h  \  is  a  prefix  of  h  such  that  P(hi)  =  i,  then 
there  is  a  prefix  h\  of  h!  such  that  h\  and  h\  arc  in  the  same  information  set;  moreover,  if  hi  ■  (rn) 
is  a  prefix  of  h  (so  that  m  was  the  action  performed  when  h  \  was  reached  in  h)  then  h\  ■  ( m )  is  a 
prefix  of  h! . 

An  augmented  game  is  defined  much  like  an  extensive  game;  the  only  essential  difference  is  that  at 
each  nonterminal  history  we  not  only  determine  the  player  moving  but  also  her  awareness  level.  Since 
the  awareness  level  is  a  set  of  runs  in  a  game  F,  we  say  that  T+  =  (Ar+,  M+  ,H+,  P  ']  .  ff ,  {if  :  i  G 
N+},  {uf  :  i  G  N+},  {Af  :  i  £  iV+})  is  an  augmented  game  based  on  the  (standard)  extensive  game 
T  =  ( N ,  Af,  H ,  P,  fc,  {Ii  :  i  £  N},  {m  :  i  £  N})  if  the  following  conditions  are  satisfied: 
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Al.  (N+ ,  M+,  H+  ,P+ ,  ff,  {Zf  :  i  £  iV+},  {uf  :  i  £  -ZV+})  is  a  (standard)  finite  extensive  game 
where  players  have  perfect  recall. 

A2.  Af  :  Hf  — >  ‘lu  describes  ?’s  awareness  level  at  each  nonterminal  history  after  which  player 
i  moves.  For  each  h  £  Hf,  Af  ( h )  consists  of  a  set  of  histories  in  H  and  all  their  prefixes. 
Intuitively,  Af  (h)  describes  the  set  of  histories  of  F  that  i  is  aware  of  at  history  h  £  Hf.  (Hav¬ 
ing  Af  (h)  consist  of  histories  rather  than  just  runs  makes  it  easier  to  deal  with  awareness  of 
unawareness.) 

A3.  N+  C  N. 

A4.  If  P+(h )  €  N+ ,  then  P+{h )  =  P{h),  where  h  is  the  subsequence  of  h  consisting  of  all  the 
moves  in  h  that  are  also  in  M,  and  Mf  C  Mj.  Intuitively,  all  the  moves  available  to  i  at  h  must 
also  be  available  to  i  in  the  underlying  game  F. 

A5.  If  P+(h )  =  c,  then  either  P(h)  =  c  and  Mf  C  M-^,  or  Mf  AM  =  0.  The  moves  in  Mf  in  the 
case  where  Alf  n  M  =  0  intuitively  capture  uncertainty  regarding  a  player’s  awareness  level. 

A6.  If  h  and  b!  arc  in  the  same  information  set  in  Zf ,  then  Af  (h)  =  Af  (h').  Intuitively,  is  awareness 
level  depends  only  on  the  information  that  i  has. 

A7.  If  h  is  a  prefix  of  b!  and  P+{h )  =  P+(h '),  then  Af(h)  C  Af(h').  This  is  a  perfect  recall 
requirement;  players  do  not  forget  histories  that  they  were  aware  of. 

A8.  If  h.  and  hf  arc  in  the  same  information  set  in  T+,  then  h  and  h’  arc  in  the  same  information  set 
in  T. 

A9.  If  h  and  hf  arc  histories  in  both  T+  and  T,  and  h  and  It  arc  in  the  same  information  set  in  T,  then 
h  and  h!  arc  in  the  same  information  set  in  T+. 
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A10.  For  all  i  G  N+  and  h  G  Hf,  if  h! ,  h"  G  Afh),  h'  and  h"  arc  in  the  same  information  set  in  F, 
then  h '  ■  (m)  G  Afh)  iff  h"  ■  (m)  G  Afh). 

All.  {z  :  z  G  Z+}  C  Z:  moreover,  for  all  i  G  N+,  h  G  Hf,  if  z  is  a  terminal  history  in  Af  ( h )  (i.e.,  if 
z  G  Af  ( h )  and  2  is  not  a  strict  prefix  of  another  element  of  Af  (h)),  then  z  C-  Z .  Thus,  the  runs 
in  Z+  correspond  to  runs  in  Z,  and  players  understand  this  fact. 

A12.  For  all  i  G  N+  and  runs  z  in  Z+,  if  z  G  Z,  then  uf(z)  =  Uifz).  Thus,  a  player’s  utility  just 
depends  on  the  moves  made  in  the  underlying  game.  (By  All,  we  have  z  G  Z.  We  have  included 
the  clause  “if  z  G  Z”  so  that  A 12  is  applicable  when  we  consider  awareness  of  unawareness, 
where  we  drop  All.) 

Conditions  A1-A12  are  intended  to  capture  our  intuitions  regarding  information  sets,  awareness, 
and  common  knowledge.  To  allow  us  to  focus  on  issues  directly  related  to  awareness,  we  have  implicitly 
assumed  that  there  is  common  knowledge  of  (1)  who  moves  at  histories  in  the  underlying  game  (this 
is  captured  by  the  fact  that  P+(h )  =  P(h)  unless  P+(h)  =  c  and  Mf  D  M  =  0  — either  the  same 
player  or  nature  moves  at  both  h  and  h  unless  nature  makes  an  “awareness”  move  at  h),  (2)  what  the 
payoffs  arc  in  the  underlying  game  (since  u+(z)  =  u(z)j,  and  (3)  what  the  information  sets  arc  in  the 
underlying  game  (see  A8-A10).  Our  approach  is  flexible  enough  to  allow  us  to  drop  these  assumptions; 
see  Section  5. 

To  understand  A8-A10,  we  must  first  discuss  our  view  of  information  sets.  As  pointed  out  by 
Flalpern  [7],  special  attention  must  be  given  to  the  interpretation  of  information  sets  in  game  trees.  This 
issue  requires  even  more  care  in  games  with  awareness.  The  standard  intuition  for  information  sets  is 
that  a  player  considers  all  the  histories  in  his  information  set  possible.  But  this  intuition  does  not  apply 
in  augmented  games.  In  an  augmented  game,  there  may  be  some  histories  in  an  /'-information  set  that  i 
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is  not  aware  of;  player  i  cannot  consider  these  histories  possible.  For  example,  consider  finitely  repeated 


prisoners  dilemma  where  Alice  and  Bob  each  move  twice  before  their  moves  arc  revealed.  Even  if  Bob 
is  not  aware  of  defection,  his  information  set  after  Alice’s  first  move  in  the  modeler’s  game  will  still 
contain  the  history  where  Alice  defects. 

We  interpret  an  /-information  set  to  be  the  set  of  all  histories  where  player  i  has  the  same  local  state. 
Intuitively,  this  local  states  encodes  all  the  information  that  i  has  about  the  moves  he  can  make,  what 
moves  have  been  made,  the  other  players  in  the  game,  his  strategy,  and  so  on.  We  assume  that  player  (’ s 
local  state  is  characterized  by  the  sequence  of  signals  that  that  i  has  received  in  the  course  of  the  game. 
Therefore,  h  and  h'  arc  in  the  same  /-information  set  in  F  iff  i  received  the  same  sequence  of  signals  in 
both  histories. 

In  standard  extensive  games,  the  sequence  of  signals  a  player  receives  after  every  history  h  is  as¬ 
sumed  to  be  common  knowledge.  (This  assumption  is  implicit  in  the  assumption  that  the  game,  is 
common  knowledge,  and  hence  so  arc  the  information  sets.)  As  we  said,  we  continue  to  assume  this 
in  games  with  awareness  (although  we  show  how  the  assumption  can  be  dropped  in  Section  5).  That  is 
why  we  require  in  A8  that  if  h  and  h!  arc  in  the  same  (-information  in  an  augmented  game,  then  h  and 
h  must  be  in  the  same  (-information  set  in  the  underlying  game.  The  converse  of  A8  does  not  neces¬ 
sarily  hold.  It  could  well  be  the  case  that  h  and  h!  arc  in  the  same  (-information  set,  but  since  (  receives 
different  signals  from  nature,  h  and  h!  arc  not  in  the  same  information  set.  On  the  other  hand,  if  all  the 
moves  in  h  and  h!  arc  already  in  the  underlying  game,  then  if  h  and  h!  arc  in  the  same  information  set 
of  T,  they  should  be  in  the  same  information  set  of  T+.  This  is  the  content  of  A9.  Since,  the  signals 
received  by  a  player  determine  the  moves  he  has  available,  if  player  (  is  aware  of  two  histories  in  the 
same  information  set  in  T,  he  must  be  aware  of  the  same  set  of  moves  available  at  both  of  these  histories. 
A 10  captures  that  intuition. 
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For  the  remainder  of  the  paper,  we  use  the  following  notation:  for  a  (standard  or  augmented)  game 


Ts,  we  denote  the  components  of  F,s  with  the  same  superscript  s,  so  that  we  have  Ms,  Hs,  and  so  on. 
Thus,  from  here  on  we  do  not  explicitly  describe  the  components  of  a  game. 

An  augmented  game  describes  either  the  modeler’s  view  of  the  game  or  the  subjective  view  of  the 
game  of  one  of  the  players,  and  includes  both  moves  of  the  underlying  game  and  moves  of  nature  that 
change  awareness.  For  example,  consider  again  the  game  shown  in  Figure  1  and  suppose  that 

•  players  A  and  B  arc  aware  of  all  histories  of  the  game; 

•  player  A  is  uncertain  as  to  whether  player  B  is  aware  of  run  {across  ,!,  down b)  and  believes  that 
he  is  unaware  of  it  with  probability  p\  and 

•  the  type  of  player  B  that  is  aware  of  the  run  (across a,  downs)  is  aware  that  player  A  is  aware  of 
all  histories,  and  he  knows  A  is  uncertain  about  his  awareness  level  and  knows  the  probability  p. 

Because  A  and  B  arc  actually  aware  of  all  histories  of  the  underlying  game,  from  the  point  of  view  of 
the  modeler,  the  augmented  game  is  essentially  identical  to  the  game  described  in  Figure  1,  with  the 
aw  areness  level  of  both  players  A  and  B  consisting  of  all  histories  of  the  underlying  game.  However, 
when  A  moves  at  the  node  labeled  A  in  the  modeler’s  game,  she  believes  that  the  actual  augmented 
game  is  I’1,  as  described  in  Figure  2.  In  T'4,  nature’s  initial  move  captures  As  uncertainty  about  /i’s 
aw  areness  level.  At  the  information  set  labeled  Al,  A  is  aw  are  of  all  the  runs  of  the  underlying  game. 
Moreover,  at  this  information  set,  A  believes  that  the  true  game  is  I’1. 

At  the  node  labeled  BA,  B  is  aware  of  all  the  runs  of  the  underlying  game  and  believes  that  the  true 
game  is  the  modeler’s  game;  but  at  the  node  labeled  B. 2,  B  is  not  aware  that  he  can  play  dow  n #,  and  so 
believes  that  the  true  game  is  the  augmented  game  described  in  Figure  3.  At  the  nodes  labeled  A. 3 
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and  B.  3  in  the  game  F/;,  neither  A  nor  B  is  aware  of  the  move  down  j>.  Moreover,  both  players  think 
the  true  game  is  F 11 . 

across^  across^ 


CU)  (2,3) 


Figure  2:  The  augmented  game  F  . 


Figure  3:  The  augmented  game  FB . 

As  this  example  should  make  clear,  to  model  a  game  with  possibly  unaw  are  players,  we  need  to 
consider  not  just  one  augmented  game,  but  a  collection  of  them.  Moreover,  we  need  to  describe,  at  each 
history  in  an  augmented  game,  which  augmented  game  the  player  playing  at  that  history  believes  is  the 
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actual  augmented  game  being  played. 


To  capture  these  intuitions,  we  define  a  game  with  awareness  based  on  Y  =  ( N ,  M ,  H .  P ,  /c,  {Z,  : 
i  G  iV},  {uj  :  i  G  IV})  to  be  a  tuple  T*  =  (£,  Fm,  P),  where 

•  Q  is  a  countable  set  of  augmented  games  based  on  T,  of  which  one  is  Fm; 

•  P  maps  an  augmented  game  F  +  <E  Q  and  a  history  h  in  T+  such  that  P+(h )  =  i  to  a  pair  (T/!  .  / ), 
where  r/l  G  Q  and  I  is  an  /'-information  set  in  game  T/l. 

Intuitively,  Tm  is  the  game  from  the  point  of  view  of  an  omniscient  modeler.  If  player  i  moves  at  h 
in  game  T+  G  Q  and  P(Y+,h)  =  ( Th,I ),  then  Th  is  the  game  that  i  believes  to  be  the  true  game 
when  the  history  is  h,  and  I  consists  of  the  set  of  histories  in  T7'  he  currently  considers  possible.  For 
example,  in  the  examples  described  in  Figures  2  and  3,  taking  F'n  to  be  the  augmented  game  in  Fig¬ 
ure  1,  we  have  P(Tm,  ())  =  (F  '1,  /),  where  /  is  the  information  set  labeled  ,4.1  in  Figure  2,  and 
JF(r-4,  (unaware,across,4})  =  {YB ,  {(across^)}). 

It  may  seem  that  by  making  T  a  function  we  cannot  capture  a  player’s  uncertainty  about  the  game 
being  played.  However,  we  can  capture  such  uncertainty  by  folding  it  into  nature’s  move.  For  example, 
we  capture  H’s  uncertainty  about  whether  B  is  aware  of  being  able  to  move  down#  in  the  augmented 
game  F  l  illustrated  in  Figure  2  by  having  nature  decide  this  at  the  first  step.  It  should  be  clear  that  this 
gives  a  general  approach  to  capturing  such  uncertainty. 

The  augmented  game  Ym  and  the  mapping  P  must  satisfy  a  number  of  consistency  conditions.  The 
first  set  of  conditions  applies  to  rm.  Since  the  modeler  is  presumed  to  be  omniscient,  the  conditions  say 
that  the  modeler  is  aware  of  all  the  players  and  moves  of  the  underlying  game. 

Ml.  Nm  =  N. 
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M2.  M  C  Mm  and  {z  :  z  €  Zmj  =  Z. 


M3.  If  Pm(h )  E  N,  then  M™  =  Mjc  If  Pm(h )  =  c,  then  either  M™  n  M  =  0  or  M™  =  and 

/cm(-  I  /»)  =  fc( ■  I  4 

Ml,  M2  and  M3  enforce  the  intuition  that  the  modeler  understands  the  underlying  game.  He  knows 
all  the  players  and  possible  moves,  and  understands  how  nature’s  moves  work  in  the  underlying  game  T. 
It  may  seem  somewhat  surprising  that  there  is  no  analogue  of  the  second  paid  of  M3  (i.e.,  the  constraint 
of  for  all  augmented  games.  While  it  makes  sense  to  have  such  an  analogue  if  nature’s  moves  arc 
in  some  sense  objective,  it  seems  like  an  unreasonable  requirement  that  all  player’s  should  agree  on 
these  probabilities  in  general.  This  is  especially  so  in  the  case  that  a  player  suddenly  becomes  aware  of 
some  moves  of  nature  that  he  was  not  aware  of  before.  It  does  not  seem  reasonable  to  assume  that  this 
aw  areness  should  come  along  with  an  understanding  of  the  probabilities  of  these  moves.  Of  course,  we 
could  require  such  an  analogue  of  M3.  Since  the  set  of  games  that  have  such  a  requirement  is  a  subset 
of  the  games  we  consider,  all  our  results  apply  without  change  if  such  a  requirement  is  imposed. 

Although  the  modeler  understands  the  underlying  game  T,  Tm  is  not  uniquely  determined  by  T. 
There  may  be  many  modeler’s  games  based  on  T,  where  the  players  have  different  awareness  levels  and 
the  awareness  changes  in  different  ways. 

The  game  Tm  can  be  thought  of  as  a  description  of  “reality”;  it  describes  the  effect  of  moves  in 
the  underlying  game  and  how  players’  awareness  levels  change.  The  other  games  in  Q  describe  a 
player’s  subjective  view  of  the  situation.  The  constraints  on  the  mapping  T  that  we  now  describe 
capture  desirable  properties  of  aw  areness. 

Consider  the  following  constraints,  where  T+  G  Q,  h  G  H+,  P+(h )  =  i,  Af(h)  =  a,  and 

p(r+,h)  =  (rh,i). 
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Cl. 

C2. 

C3. 


C4. 

C5. 


C6. 

C7. 

C8. 


C9. 


CIO. 


{h:he  Hh}  =  a. 

If  h!  G  Hh  and  Ph(h !)  =  j,  then  Aj(h')  C  a  and  M-g  n  {m  :  h!  ■  (m)  6a}  =  Mfy. 

If  h!  and  h  are  in  the  same  information  set  in  F+  and  h!  G  a,  then  there  exists  h"  G  I  such  that 


h"  =  h\ 


If  b!  G  I,  then  A’l(h')  =  a  and  P{Th,  h')  =  ( Th ,  I). 

If  /;/  G  H  1  .  P+(h')  =  i,  f h' )  =  a,  then  if  h  and  h'  arc  in  the  same  information  set  of  r+, 
then  ^(r+,  h')  =  ( Th ,  /),  while  if  h  is  a  prefix  or  a  suffix  of  h! ,  then  ^r(r+,  h!)  =  ( Th ,  P)  for 
some  z-information  set  V . 

If  h'  G  /,  then  h  and  h!  arc  in  the  same  information  set  in  F; 

If  rh  =  T+,  then  h!  G  I  iff  h  and  h'  arc  in  the  same  z-information  set  in  F+. 

For  all  histories  h!  G  /,  there  exists  a  prefix  h\  of  /;/  such  that  Ph(h[)  =  i  and  P(Th\  h[ )  = 
(r',  P)  iff  there  exists  aprefix  h\  of  h  such  that  P+{h\ )  =  z  and  JF(r+,  h\ )  =  (r',  P).  Moreover, 
h\  ■  (m)  is  a  prefix  of  h'  iff  h\  ■  (m)  is  a  prefix  of  h. 

There  exists  a  history  h!  G  I  such  that  for  every  prefix  h"  •  (rnj  of  h! ,  if  Ph(h ")  =  j  G  Nh  and 
P{Th,  h")  =  (r7,  P),  then  for  all  hi  G  hx  •  (m)  G  H' . 

If  h!  and  h"  arc  histories  in  both  F  !'  and  rh,  then  h'  and  h"  arc  in  the  same  z-information  set  in 
r+  iff  h!  and  h"  arc  in  the  same  z-information  set  in  r/l. 


Suppose  that  P(V+ ,  h)  =  (F/l,  I).  Player  z  moving  at  history  h  in  T+  thinks  the  actual  game  is 
Moreover,  z  thinks  he  is  in  the  information  set  of  I  of  r/l.  Cl  guarantees  that  the  set  of  histories  of  the 
underlying  game  player  z  is  aware  of  is  exactly  the  set  of  histories  of  the  underlying  game  that  appear 
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in  rft  .  C2  states  that  no  player  in  T/l  can  be  aware  of  histories  not  in  a.  The  second  part  of  C2  implies 
that  the  set  of  moves  available  to  player  j  at  h!  is  just  the  set  of  moves  that  player  i  is  aware  of  that  arc 
available  to  j  at  h!  in  the  underlying  game.  C3  guarantees  that  for  all  histories  h!  indistinguishable  from 
h  that  player  i  is  aware  of,  there  exists  some  history  h"  €  I  differing  from  h!  at  most  in  some  moves  of 
nature  that  change  awareness  levels.  C4  says  that  at  all  histories  in  /  player  i  indeed  thinks  the  game  is 
and  that  the  information  set  is  I.  C5  says  that  player  V s  subjective  view  of  the  game  changes  only 
if  i  becomes  aware  of  more  moves  and  is  the  same  at  histories  in  H+  that  i  cannot  distinguish.  C6 
captures  the  assumption  that  at  all  histories  i  considers  possible,  he  must  have  gotten  the  same  signals 
as  he  does  in  the  actual  history. 

C7  says  that  if  while  moving  at  history  h  player  i  thinks  that  T+  is  the  actual  game,  then  he  considers 
possible  all  and  only  histories  in  the  information  set  containing  h.  C8  is  a  consequence  of  the  perfect 
recall  assumption.  C8  says  that  if,  at  history  h,  i  considers  b!  possible,  then  for  every  prefix  h\  of 
h!  there  is  a  corresponding  prefix  of  h  where  i  considers  himself  to  be  playing  the  same  game,  and 
similarly,  for  every  prefix  of  h  there  is  a  prefix  of  h!  where  i  considers  himself  to  be  playing  the  same 
game.  Moreover,  i  makes  the  same  move  at  these  prefixes. 

The  intuition  behind  condition  C9  is  that  player  i  knows  that  player  j  only  make  moves  that  j  is 
aware  of.  Therefore,  player  i  must  consider  at  least  one  history  h!  where  he  believes  that  every  player  j 
made  a  move  that  j  was  aware  of.  It  follows  from  All,  Cl,  C2,  and  C9  that  there  is  a  run  going  through 
/  where  every  player  j  makes  a  move  that  player  i  believes  that  j  is  aware  of. 

Since  we  assume  that  players  have  (modulo  awareness)  common  knowledge  about  information  sets, 
if  T+  is  the  game  from  the  point  of  view  of  player  j  (or  the  modeler)  and  there  arc  histories  h!  and  h"  in 
both  T+  and  Tft,  then  player  j  (or  the  modeler)  knows  that  player  i  gets  the  same  signals  in  both  h’  and 
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h"  iff  he  knows  that  player  i  knows  that  he  gets  the  same  signals  in  those  histories.  CIO  captures  that 
intuition. 

Just  as  Tm  is  not  uniquely  determined  by  F,  T{Y+ .  h )  depends  on  more  than  just  the  awareness 
level  of  the  player  who  moves  at  h.  That  is,  even  if  Ai(h)  =  Ai(h'),  we  may  have  ^r(T+,  h)  =  (Th,  I) 
and  J7(T+,h')  =  (Th> ,/')  with  Th  ^  rft\  We  do  not  require  that  the  awareness  level  determines 
the  game  a  player  considers  possible.  This  extra  flexibility  allows  us  to  model  a  situation  where,  for 
example,  players  2  and  3,  who  have  the  same  awareness  level  and  agree  on  the  awareness  level  of  player 
1,  have  different  beliefs  about  the  game  player  1  considers  possible.2 

A  standard  extensive  game  T  can  be  identified  with  the  game  ({Tm  },  Tm,  J7),  where  (abusing  nota¬ 
tion  slightly)  Tm  =  (T,  {A,  :  i  G  N })  and,  for  all  histories  h  in  an  z-information  set  /  in  T,  At(h)  =  H 
and  jF(Tm,  h)  =  (Tm,  I).  Thus,  all  players  arc  aware  of  all  the  runs  in  T,  and  agree  with  each  other  and 
the  modeler  that  the  game  is  T.  We  call  this  the  canonical  representation  ofT  as  a  game  with  awareness. 

One  technical  issue:  We  have  assumed  that  the  set  Q  of  games  in  a  game  T*  with  awareness  is 

countable.  For  our  purposes,  this  is  without  loss  of  generality.  We  arc  ultimately  interested  in  what 

happens  in  the  game  Tm,  since  this  is  the  game  actually  being  played.  However,  to  analyze  that,  we 

need  to  consider  what  happens  in  other  games  in  Q.  For  example,  if  h  is  a  history  in  F'"  where  i  moves, 

we  need  to  understand  what  happens  in  the  game  F/(  such  that  h)  =  (F/l,  •),  since  is  the 

game  that  i  thinks  is  being  played  at  history  h  in  F”' .  It  is  not  hard  to  see  that  the  set  of  games  we  need 
2 If  the  beliefs  of  players  2  and  3  regarding  1  are  compatible  with  a  common  prior,  then  we  can  view  players  2  and  3  as 
considering  different  information  sets  in  the  same  game  possible.  However,  if  their  beliefs  are  not  compatible  with  a  common 
prior,  for  example,  if  player  2  believes  that  player  1  believes  that,  in  history  h,  IT  is  the  actual  game  with  probability  1,  and 
player  3  believes  that,  in  history  h,  player  1  believes  that  IT  is  the  actual  game  with  probability  1.  where  Ti  A  Y2,  then  we 
cannot  view  players  2  and  3  as  considering  the  same  game  possible. 
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to  consider  is  the  least  set  Q'  such  that  P"  G  Q'  and,  for  every  P  G  Q  and  history  h  in  F7  such  that 
JF(r',  h )  =  (r",  •),  F"  G  Q' .  Q'  is  guaranteed  to  be  countable,  even  if  Q  is  not. 

3  Local  strategies  and  generalized  Nash  equilibrium 
3.1  Local  Strategies 

In  this  section,  we  generalize  the  notion  of  Nash  equilibrium  to  games  with  awareness.  To  do  that,  we 
must  first  define  what  a  strategy  is  in  a  game  with  awareness.  Recall  that  in  a  standard  game,  a  strategy 
for  player  i  is  a  function  from  i-information  sets  to  a  move  or  to  a  distribution  over  moves,  depend¬ 
ing  on  whether  we  are  considering  pure  (i.e.,  deterministic)  strategies  or  behavioral  (i.e.,  randomized) 
strategies.  The  intuition  is  that  player  i’ s  actions  depend  on  what  i  knows;  the  strategy  can  be  viewed  as 
a  universal  plan ,  describing  what  i  will  do  in  every  possible  situation  that  can  arise.  This  makes  sense 
only  because  i  is  presumed  to  know  the  game  tree,  and  thus  to  know  in  advance  all  the  situations  that 
can  arise. 

In  games  with  aw  areness,  this  intuition  no  longer  makes  sense.  For  example,  player  i  cannot  plan 
in  advance  for  what  will  happen  if  he  becomes  aw  are  of  something  he  is  initially  unaw  are  of.  We  must 
allow  r  s  strategy  to  change  if  he  becomes  aw  are  of  more  moves.  Let  Q,  =  {F7  G  Q  :  for  some  T+  G 
Q  and  h  in  T+,  P+(h )  =  i  and  P(r+,  h )  =  (r7,  •)}.  Intuitively,  Qi  consists  of  the  games  that  i  views  as 
the  real  game  in  some  history.  Thus,  rather  than  considering  a  single  strategy  in  a  game  T*  =  (Q .  F'P  T) 
with  aw  areness,  we  consider  a  collection  {o^r'  :  F7  G  Qi}  of  what  we  call  local  strategies,  one  for  each 
augmented  game  in  Q,  .  Intuitively,  a  local  strategy  (t,  yi  for  game  F7  is  the  strategy  that  i  would  use  if  i 
were  called  upon  to  play  and  i  thought  that  the  true  game  was  IP  Thus,  the  domain  of  crt.r'  consists  of 
pairs  (r+,  h )  such  that  T+  G  Q,  h  is  a  history  in  T+,  P+(h )  =  i,  and  P(r+,  h)  =  (T7, 1). 
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Define  an  equivalence  relation  on  pairs  (r7,  h )  such  that  F7  6  Q  and  h  is  a  history  in  F7  where 
i  moves  such  that  (Ti,  h\)  (r2,  hf)  if  ,F(ri,  h\)  =  ^(Tz,  hz).  We  can  think  of  as  defining  a 

generalized  information  partition  in  F* .  It  is  easy  to  check  that  a  equivalence  class  consists  of  a  union 
of  /-information  sets  in  individual  games  in  Q.  Moreover,  if  some  element  of  a  equivalence  class  is 
in  the  domain  of  cr^rs  then  so  is  the  whole  equivalence  class.  At  all  pairs  (F7,  hi)  in  a  equivalence 
class,  if  ^(r7,  hi)  =  (rh',  I),  player  i  thinks  he  is  actually  playing  in  the  information  set  /  of  Th' .  Thus, 
we  require  that  atyi (Fi ,  hi)  =  cq ;)r'(r2,  hz)  if  (Fi,  ^1)  and  (T 2 ,  hz)  are  both  in  the  domain  of  alyi  and 
(Ft,  fit)  (r2,  hz)- 

The  following  definition  summarizes  this  discussion. 

Definition  3.1  Given  a  game  with  awareness  F*  =  (Q .  F'n  .  T),  a  local  strategy  al  p/  for  agent  i  is  a 
function  mapping  pairs  (r+,  h)  such  that  h  is  a  history  where  i  moves  in  F  f  and  ^r(r+,  h)  =  (r7, 1)  to 
a  probability  distribution  over  M'h,,  the  moves  available  at  a  history  hi  €  /,  such  that  oty/ (T 1 ,  h\ )  = 
^iyij^z-ihz)  if(Ti,hi)  (r2,/i2)- 

Note  that  there  may  be  no  relationship  between  the  strategies  oyp/  for  different  games  F'.  Intuitively, 
this  is  because  discovering  about  the  possibility  of  a  different  move  may  cause  agent  i  to  totally  alter  his 
strategy.  We  could  impose  some  consistency  requirements,  but  we  have  not  found  any  that  we  believe 
should  hold  in  all  games.  We  believe  that  all  our  results  would  continue  to  hold  in  the  presence  of 
reasonable  additional  requirements,  although  we  have  not  explored  the  space  of  such  requirements. 

3.2  Generalized  Nash  Equilibrium 

We  want  to  define  a  notion  of  generalized  Nash  equilibrium  so  as  to  capture  the  intuition  that  for  every 
player  i,  if  i  believes  he  is  playing  game  F7,  then  his  local  strategy  oryi  is  a  best  response  to  the  local 
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strategies  of  other  players  in  T7. 


Define  a  generalized  strategy  profile  of  T*  =  (Q.  Trn.  T)  to  be  a  set  of  local  strategies  &  =  {rr,:  r/  : 
i  E  N.  Y'  E  Qi}.  Let  EUij'fc f)  be  the  expected  payoff  for  i  in  the  game  F'  given  that  strategy  profile 
a  is  used.  Note  that  the  only  strategies  in  o  that  are  needed  to  compute  EUi r'(<?)  are  the  strategies 
actually  used  in  F';  indeed,  all  that  is  needed  is  the  restriction  of  these  strategies  to  information  sets  that 
arise  in  r'. 

A  generalized  Nash  equilibrium  of  T*  =  (G.  Tm,  T)  is  a  generalized  strategy  profile  <r  such  that  for 
all  T'  E  Gi,  the  local  strategy  glx!  is  a  best  response  to  p'F  where  <r_(i>r/)  is  the  set  of  all  local 
strategies  in  o  except  rr,  p/. 

Definition  3.2  A  generalized  strategy  profile  a*  is  a  generalized  Nash  equilibrium  of  a  game  T*  = 
(G,  rm,  E)  with  awareness  if,  for  every  player  i,  game  Y'  E  Gi,  and  local  strategy  a  for  i  in  F', 

EUitr'(d*)  >  EUitr/((of{in,o)). 

The  standard  definition  of  Nash  equilibrium  would  say  that  d  is  a  Nash  equilibrium  if  (T,  is  a  best 
response  to  n_l.  This  definition  implicitly  assumes  that  player  i  can  choose  a  whole  strategy.  This 
is  inappropriate  in  our  setting.  An  agent  cannot  anticipate  that  he  will  become  aware  of  more  moves. 
Essentially,  if  Ti  f  w-e  are  treating  player  i  who  considers  the  true  game  to  he  Fi  to  be  a  different 
agent  from  the  version  of  player  i  who  considers  F2  to  be  the  true  game.  To  understand  why  this  is 
appropriate,  suppose  that  player  i  considers  Ti  to  be  the  true  game,  and  then  learns  about  more  moves, 
and  so  considers  to  be  the  true  game.  At  that  point,  it  is  too  late  for  player  i  to  change  the  strategy 
he  was  playing  when  he  thought  the  game  was  Ti.  He  should  just  try  to  play  optimally  for  what  he  now 
considers  the  true  game.  Moreover,  while  player  i  thinks  that  the  game  F]  is  the  true  game,  he  never 
considers  it  possible  that  he  will  ever  be  playing  a  different  game,  so  that  he  cannot  “prepare  himself” 
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for  a  change  in  his  subjective  view  of  the  game.3  These  considerations  suggest  that  our  notion  of  Nash 
equilibrium  is  appropriate. 

It  is  easy  to  see  that  a  is  a  Nash  equilibrium  of  a  standard  game  iff  a  is  a  (generalized)  Nash 
equilibrium  of  the  canonical  representation  of  T  as  a  game  with  awareness.  Thus,  our  definition  of 
generalized  Nash  equilibrium  generalizes  the  standard  definition. 

Consider  the  game  with  awareness  shown  in  Figures  1  (taking  this  to  be  Tm),  2,  and  3.  We  have 
Qa  =  {T'1 ,  |  and  Qb  =  { Tr".  TR}.  Taking  dorn(a^pd)  to  denote  the  domain  of  the  strategy  <7^ rs 

we  have 

dom(aArA  )  =  {{rm ,  ()),  ( rA ,  (unaware)),  ( rA ,  (aware))}, 
dom(aB,rm)  =  {{rm,  (across^)),  ( rA ,  (aware,  across^))}, 
dom(a ArB)  =  {(Ts,())},  and 

dom(aB^rB)  =  {{rA,  (unaware,across^)),  (rB ,  (across^))}. 

Each  of  these  domains  consists  of  a  single  generalized  information  set.  If  p  <  1/2,  then  there  exists  a 

generalized  Nash  equilibrium  where  crA  rA  =  across^,  aA  r«  =  down  i,  a _e,rm  =  downs,  17 ri  r«  = 

across/-;.  Thus,  in  the  modeler’s  game,  A  plays  across  ,/ ,  B  plays  downs,  and  the  resulting  payoff  vector 

is  (2,  3).  On  the  other  hand,  if  p  >  1/2,  then  there  exists  a  generalized  Nash  equilibrium  where  aA  rw  = 

downer,  (Jaxb  =  ('ow|l4,  crs,rm  =  downs,  °srs  =  across s ■  Thus,  in  the  modeler’s  game,  A  plays 

downer,  and  the  payoff  vector  is  (1, 1).  Intuitively,  even  though  both  A  and  B  arc  aware  of  all  the  moves 

in  the  modeler’s  game,  A  considers  it  sufficiently  likely  that  B  is  not  aware  of  downs,  so  A  plays 

down^.  There  exists  another  generalized  Nash  equilibrium  where  a A  r,t  =  down  /,  aA  r«  =  down  /, 

<7s, rm  =  acrosss,  and  aB  rH  =  acrosss  that  holds  for  any  value  of  p.  Intuitively,  A  believes  B  will 

Tn  games  with  awareness  of  unawareness,  an  agent  may  consider  it  possible  that  he  will  become  aware  of  more  informa¬ 
tion.  But  this  too  is  incorporated  in  his  view  of  the  game,  so  he  can  still  do  no  better  than  playing  optimally  in  his  current  view 
of  the  game. 
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play  across#  no  matter  what  he  ( B)  is  aware  of,  and  therefore  plays  down  ,4:  given  that  A  plays  down^, 
B  cannot  improve  by  playing  down#  even  is  he  is  aw  are  of  that  move.4 

We  now  show  that  every  game  with  awareness  has  at  least  one  generalized  Nash  equilibrium.  We 
proceed  as  follows.  Given  a  game  F*  =  (Q.  Fr",  YF)  with  awareness,  let  v  he  a  probability  on  Q  that 
assigns  each  game  in  Q  positive  probability.  (Here  is  where  we  use  the  fact  that  Q  is  countable.)  We 
construct  a  standard  extensive  game  F"  by  essentially  “gluing  together”  all  the  games  F'  G  Q,  except 
that  we  restrict  to  the  histories  in  V  that  can  actually  be  played  according  to  the  players’  awareness 
level.  Formally,  for  each  Y'  G  (/,  we  restrict  to  the  histories  \H'\  =  [h  E  H'  :  for  every  prefix  h\  ■  (m) 
of  h,  if  P'{h{)  =  i  G  N  and  ^(r',  h\)  =  (FT  I),  then  for  all  I12  G  I,  h,2  ■  (m)  G  H"\.  As  we  shall 
see,  all  the  components  of  Tv  are  independent  of  u  except  for  nature’s  initial  move  (as  encoded  by  f1'.). 
In  T",  the  set  of  players  is  { (i.  F')  :  V  G  G, } .  The  game  tree  of  F"  can  be  viewed  as  the  union  of  the 
pruned  game  trees  of  F'  G  Q.  The  histories  of  Y1'  have  the  form  (F')  •  h,  where  G  Q  and  h  G  |  Hh  \ . 
The  move  that  a  player  or  nature  makes  at  a  history  (F7)  ■  h  oYTu  is  the  same  as  the  move  made  at  h 
when  viewed  as  a  history  of  IT  The  only  move  in  F'/  not  determined  by  T*  is  nature’s  initial  move  (at 
the  history  ( )),  where  nature  chooses  the  game  T'  G  G  with  probability  v(Y'). 

Formally,  let  Tu  be  a  standard  game  such  that 

•  Nv  =  :  r  G  Qij; 

•  Mu  =  Q  Ur'eg  [M’\ ,  where  [M' J  is  the  set  of  moves  that  occur  in  \_H’ J; 

•  H”  =  ()U{(V)-h-.T'  €Q,h£ 

4We  did  not  discuss  this  latter  equilibrium  in  the  preliminary  version  of  this  paper. 
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Pu(0)  =  C,  and 


(i,rh')  if  Ph(h')  =  i  e  N  and 
P(Th,ti)  = 


Pu{(Th)  ■  h')  = 

[  c  if  Ph(h')=c-, 

•  /c  (r'K >)  =  i/( V)  and  ff(-\{Th)  ■  h')  =  f£(.\h')  if  P\ti)  =  c; 

•  Zf r,  is  just  the  relation  restricted  to  histories  (T".  h)  €  Z/'7  where  i  moves  and  ^(r",  h)  has 
the  form  (T'.  ■); 

u?(z)  ifrh  =  r', 
o  ifrh/r. 

Theorem  3.1  For  all  probability  measures  v  on  Q 

(a)  Tu  is  a  standard  extensive  game  with  perfect  recall;  and 

( b)  if  u  gives  positive  probability  to  all  games  in  Q,  then  a  is  a  Nash  equilibrium  of  V'  iff  o'  is  a 
generalized  Nash  equilibrium  ofT*,  where  aipi((Th)  ■  h')  =  ex'  r/(rft,  h'). 

Although  a  Nash  equilibrium  does  not  necessarily  exist  in  games  with  infinitely  many  players,  Tu 
has  three  special  properties:  (a)  each  player  has  only  finitely  many  information  sets,  and  (b)  for  each 
player  (i,  T'),  there  exists  a  finite  subset  N(i.  P)  of  Nu  such  that  (i.  Tj’s  payoff  in  F'y  depends  only 
on  the  strategies  of  the  players  in  N(i,  F'),  and  (c)  Tv  is  a  game  with  perfect  recall.  This  turns  out  to 
be  enough  to  show  that  Tv  has  at  least  one  Nash  equilibrium.  Thus,  we  get  the  following  corollary  to 
Theorem  3.1. 

Corollary  3.1  Every  game  with  awareness  has  a  generalized  Nash  equilibrium. 
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4  Modeling  Awareness  of  Unawareness 


In  this  section,  we  describe  how  to  extend  our  representation  of  games  with  awareness  to  deal  with 
awareness  of  unawareness.  In  an  augmented  game  that  represents  player  V s  subjective  view  of  the 
game,  we  want  to  model  the  fact  that  i  may  be  aware  of  the  fact  that  j  can  make  moves  at  a  history  h 
that  i  is  not  aware  of.  We  do  this  by  allowing  j  to  make  a  “virtual  move”  at  history  h.  Histories  that 
contain  virtual  moves  arc  called  virtual  histories.  These  virtual  histories  do  not  necessarily  correspond 
to  a  history  in  the  underlying  game  T  (i.e.,  i  may  falsely  believe  that  j  can  make  a  move  at  h  that  he  is 
unaware  of),  and  even  if  a  virtual  history  does  correspond  to  a  history  in  T,  the  subgame  that  follows 
that  virtual  history  may  hear  no  relationship  to  the  actual  subgame  that  follows  the  corresponding  history 
in  the  underlying  game  T.  Intuitively,  the  virtual  histories  describe  agent  V s  (possibly  incomplete  and 
possibly  incorrect)  view  of  what  would  happen  in  the  game  if  some  move  she  is  unaware  of  is  made  by 
agent  j.  Player  j  may  have  several  virtual  moves  available  at  history  h,  and  may  make  virtual  moves  at 
a  number  of  histories  in  the  augmented  game.5  Note  that  agent  i’s  subjective  game  may  include  virtual 
moves  for  i  himself;  i  may  believe  that  he  will  become  aware  of  more  moves  (and  may  take  active  steps 
to  try  and  learn  about  these  moves). 

To  handle  awareness  of  unaware  ness,  we  consider  a  generalization  of  the  notion  of  augmented  game. 

We  continue  to  refer  to  the  generalized  notion  as  an  augmented  game,  using  “augmented  game  without 

awareness  of  unawareness”  to  refer  to  the  special  case  we  have  focused  on  up  to  now.  Formally,  T+  = 

(N+ ,  M+ ,  H+ ,  P+,  /+,  {if  :  i  G  iV+},{ri/"  :  i  G  N+},  {A+  :  i  G  iV+})  is  an  augmented  game 
5 In  the  preliminary  version  of  the  paper,  we  assumed  that  all  virtual  moves  were  terminal  moves.  This  is  appropriate  if  i 
has  no  idea  at  all  of  what  will  happen  in  the  game  after  a  virtual  move  is  made.  The  greater  generality  we  allow  here  is  useful 
to  model  situations  where  player  i  has  some  partial  understanding  of  the  game.  For  example,  i  may  know  that  he  can  move 
left  after  j’s  virtual  move,  no  matter  what  that  virtual  move  is. 
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based  on  the  (standard)  finite  extensive  game  T  =  (N,  M,  H .  P.  fc,  {Z,;  :  i  £  N},  {m  :  i  £  N })  if  it 
satisfies  conditions  A1-A3,  A6-A10  and  A12  of  augmented  games,  and  valiants  of  A4,  A5,  and  A8.  6 
Before  stating  these  valiants  we  need  to  define  formally  the  set  of  virtual  histories  of  T+.  The  set  of 
virtual  histories  V+  ofT+  is  defined  by  induction  on  the  length  of  histories  as  follows: 

1.  if  m  £  H+ ,  m  £  M+  —  M,  and  either  P+(0)  £  N+  or  P+(0)  =  c  =  P(0),  then  m  £  V+\ 

2.  if  h  ■  (m)  £  H+  and  h  £  V+,  then  h  ■  (m)  £  V+; 

3.  if  h  ■  (m)  £  H+,  m  £  M+  —  M,  h  ^  V+,  and  either  P+(h )  £  N+  or  P+(h )  =  c  =  P(h),  then 

m  £  V+,  where  if  h  ^  V+,  then  h  is  the  subsequence  of  h  consisting  of  all  moves  in  h  that  are 
also  in  M,  and  if  h  £  V+,  then  h  =  h. 

We  can  now  state  the  valiants  of  A4,  A5,  and  A8. 

A4'.  If  P+(h )  £  N+  and  h  £  V+,  then  P+(h )  =  P{h)  and  M C  Mj  U  ( M+  —  M). 

A5'.  If  P+(h)  =  c  and  h  ^  V+,  then  either  P(h )  =  c  and  C  U  ( M+  —  M ),  or  P{h)  c  and 

n  M  =  0. 

A8'.  If  h  and  h'  arc  in  the  same  information  set  in  T+  and  h,  h'  (f:  V+,  then  h  and  h  arc  in  the  same 
information  set  in  T. 

A  game  with  awareness  of  unawareness  based  on  T  is  defined  as  a  tuple  T*  =  (Q .  T"1.  T)  just 
as  before.  The  modeler’s  extended  game  Tm  satisfies  the  same  conditions  M1-M3  as  before,  and  the 
mapping  T  satisfies  C3-C5  and  C7-C10  and  the  following  valiants  of  Cl,  C2,  and  C6: 

Cl',  {h  :  h  £  Hh,hf  Vh}  =  a. 

6We  could  also  relax  A3  to  allow  some  “virtual  players”.  We  do  not  do  that  here  for  ease  of  exposition. 
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C2'.  If  h!  G  fF71  and  Ph(h ')  =  j,  then  (a)  Ah-{hr)  C  a,  (b)  if  h!  ^  Vh,  then  (M^  D  {m  :  h!  ■  (m)  G 
a})  U  (Mfy  —  Mj^i)  =  M ft,,  and  (c)  if  ^(T^/i/)  =  (r',/'),  then  for  all  h"  G  we  have 

K  "  c  . 

C6'.  If  h'  G  /  and  h,  h!  £  Vh,  then  /(  and  h'  are  in  the  same  information  set  in  F. 

CF  and  C6'  have  been  weakened  so  that  these  restrictions  only  apply  to  non-virtual  histories  of  I’F  Paid 
(a)  of  C2'  is  the  same  as  the  first  part  of  C2;  paid  (b)  implies  that  the  set  of  moves  available  to  player 
j  at  a  non-virtual  history  b!  is  the  set  of  moves  that  player  i  is  aware  of  that  are  available  to  j  at  Ii  in 
the  underlying  game  together  with  some  virtual  moves.  It  is  not  hard  to  check  that  in  games  without 
awareness  of  unawareness,  paid  (c)  follows  from  A4,  Cl,  and  C2,  so  it  does  not  need  to  be  explicitly 
stated  in  C2.  However,  now  that  A4  has  been  weakened  to  A4',  we  must  mention  it  explicitly. 

Note  that  F”'  is  an  augmented  game  with  no  awareness  of  unawareness;  there  arc  no  virtual  moves, 
since  the  modeler  is  indeed  aware  of  all  possible  moves  (and  knows  it).  We  can  now  define  local 
strategies,  generalized  strategy  profiles,  and  generalized  Nash  equilibrium  just  as  we  did  for  games  with 
awareness.  The  same  technique  as  that  used  to  show  Corollary  3.1  can  be  used  to  prove  the  following. 

Theorem  4.1  Every  game  with  awareness  of  unawareness  has  a  generalized  Nash  equilibrium. 

5  Modeling  Lack  of  Common  Knowledge 

Game  theorists  have  long  searched  for  good  approaches  to  modeling  games  where  there  is  no  common 
knowledge  among  players  regarding  the  game  being  played.  Our  approach  is  flexible  enough  to  handle 
such  lack  of  common  knowledge.  In  this  section,  we  discuss  the  changes  needed  to  handle  lack  of 
common  knowledge.  We  remark  that  what  we  do  here  makes  perfect  sense  even  in  games  where  there 
is  full  awareness. 
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We  can  modify  our  model  to  accommodate  four  different  aspects  of  lack  of  common  knowledge. 


•  Lack  of  common  knowledge  regarding  who  moves.  We  assumed  that  every  player  understands 
who  moves  in  each  history  he  is  aware  of.  Although  we  still  need  to  require  that  every  player 
knows  when  it  is  his  turn  to  move,  we  can  handle  the  case  where  a  player  has  false  beliefs  about 
who  moves  after  a  history  that  is  not  in  one  of  his  information  sets.  For  example,  we  arc  interested 
in  modeling  the  case  where  player  i  may  be  confused  after  some  history  h  as  to  whether  player 
j  or  player  k  moves,  but  in  both  cases  i  still  believes  that  the  same  moves  are  available.  That  is, 
player  i  knows  what  could  happen  next,  but  he  does  not  know  who  is  going  to  do  it.  (Later  we 
model  uncertainty  not  only  regarding  who  moves  but  also  regarding  what  the  move  is.) 

To  explain  the  necessary  modifications,  we  need  one  more  definition.  Let  Qm,i  be  the  smallest 
subset  of  Q  such  that  if  either  T+  =  Tm  or  T+  £  Qm:i,  h  £  H+,  P+(h )  =  i,  and  J-"(r+,  h )  = 
(T',  •),  then  T7  £  Grn.i-  Intuitively,  Qm,i  consists  of  all  games  player  i  considers  possible,  or 
considers  possible  that  he  considers  possible,  and  so  on,  at  some  history  of  the  modeler’s  game. 

We  can  model  lack  of  common  knowledge  about  who  moves  by  replacing  A4  by 
A4".  If  P+(h)  =  i  £  N+,  then  M+  C  A%. 

Thus,  we  no  longer  require  that  the  player  who  moves  at  history  h  is  necessarily  the  one  who 
moves  at  h.  However,  we  do  make  this  requirement  for  the  modeler’s  game,  since  the  modeler 
is  assumed  to  understand  the  underlying  game.  Thus,  we  must  add  a  requirement  M4  for  the 
modeler’s  game  that  is  identical  to  A4  except  that  we  replace  T+  by  Tm. 

Player  i  must  also  understand  that  he  moves  at  a  history  h  iff  he  moves  at  h  for  games  in  Qm,i- 
Cll.  If  T+  eg,  he  H+,  P+(h )  =  i,  Aj{h)  =  a,  F(T+,h)  =  ( Fh,I ),  and  h!  £  Hh,  then  if 
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Th  G  Gmj  and  Ph(h!)  =  i,  then  P(h')  =  i.  Conversely,  if  P(h!)  =  i,  then  there  exists  a 
prefix  or  suffix  h”  of  h!  such  that  h"  =  h!  and  Ph(h”)  =  i. 

We  also  need  to  make  modifications  to  A5.  Since  we  want  to  allow  a  player  to  have  false  beliefs 
about  when  nature  moves,  we  replace  A5  with 

A5".  If  P+{h)  =  c,  then  either  M ^  C  Mj,  or  M £  n  M  =  0. 

As  before,  the  moves  in  in  the  case  where  fl  M  =  0  intuitively  capture  uncertainty 
regarding  a  player’s  awareness  level.  But  now  it  may  be  the  case  that  a  player  i  falsely  believes 
that  nature  moves  after  history  h  in  the  underlying  game.  Just  as  with  A4,  we  must  add  a  condition 
M5  to  the  modeler’s  game  that  is  identical  to  A5,  except  that  I’  is  replaced  by  Tm. 

•  Lack  of  common  knowledge  about  the  information  sets.  We  assumed  that  every  player  understand 
the  signals  every  other  player  receives  in  every  history  he  is  aware  of.  We  can  weaken  this  as¬ 
sumption  by  allowing  a  player  to  have  false  beliefs  about  the  signals  received  by  other  players,  or 
equivalently,  by  allowing  a  player  to  have  false  beliefs  about  the  information  sets  of  other  players. 

We  can  model  lack  of  common  knowledge  about  the  information  sets  by  removing  conditions 
A8-A10.  Again,  because  we  assume  that  the  modeler  understands  the  information  sets,  we  would 
add  analogues  of  A8-A10  to  the  conditions  on  the  modeler’s  game  (replacing  F  by  Fr",  of 
course).  Similarly,  we  would  require  analogues  of  A8  and  A9  to  hold  in  the  “C-list”  of  conditions 
for  games  G  Qm,i,  and  we  weaken  C6  so  that  it  also  holds  only  for  I^'  G  Qm.i-  We  must 
also  add  an  analogue  of  A 10  to  the  “C-list”  for  games  G  Qm,i  for  histories  h!  and  h"  in  an 
z- information  set. 

•  Lack  of  common  knowledge  about  payoffs.  We  assumed  that  payoffs  depended  only  on  moves 
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of  the  underlying  game  and  that  they  were  common  knowledge  among  players.  By  dropping 


condition  A12,  we  remove  both  of  these  assumptions.  If  we  want  to  require  that  payoffs  depend 
only  on  the  underlying  game,  but  still  want  to  allow  players  to  have  false  beliefs  about  the  utilities, 
we  would  add  an  analogue  of  A12  in  the  modeler’s  game  and  use  the  following  weakening  of  A12: 

A12'.  If  r+  €  Q,  z,  z'  €  Z+,  and  z  =  z\  then  for  all  i  €  N+,  uf  (z)  =  uf  (. z '). 

Although  the  player  j  whose  view  of  the  game  is  T  1  may  have  false  beliefs  about  the  payoffs, 
player  j  knows  that  the  payoffs  depend  only  on  the  moves  made  in  the  underlying  game.  A12' 
captures  that  intuition. 

•  Lack  of  common  knowledge  of  the  underlying  game.  We  assumed  players  have  common  knowl¬ 
edge  about  the  structure  of  the  underlying  game.  Our  framework  can  model  a  situation  where 
each  player  has  a  completely  different  conception  of  what  game  is  actually  being  played,  which 
may  have  very  little  relationship  to  the  actual  underlying  game  (although  we  still  assume  that  the 
modeler’s  game  corresponds  to  the  actual  game).  The  key  idea  is  to  drop  the  assumption  that  all 
augmented  games  arc  based  on  the  same  game  T. 

To  formalize  this  intuition,  we  modify  A2  so  that  the  A-  function  does  not  necessarily  map 
histories  of  an  augmented  game  to  histories  of  the  same  game  T.  Rather,  A+(h)  is  the  set  of 
histories  of  some  game  T(/i)  that,  intuitively,  i  considers  to  be  the  true  underlying  game.  Thus, 
if  h  and  h!  arc  two  histories  in  T+,  then  Af  (h)  and  Af  (h!)  may  be  histories  in  two  completely 
different  games.  Since  T(/i)  is  viewed  as  is  subjective  view  of  the  true  underlying  game, 
we  assume  that  he  understands  it  perfectly.  Thus,  we  retain  Al,  A6  and  A8-A12  and  replace 
conditions  A3-A5  by  M1-M3  (where  the  set  of  players  is  the  set  of  players  in  T(/i)  and  the 
projection  function  maps  a  history  h  to  a  history  h  in  Y(h)).  With  regal'd  to  A7,  note  that,  even 
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if  a  player  intuitively  has  perfect  recall,  he  may  realize  in  the  future  that  he  does  not  consider 


possible  a  history  he  considered  possible  in  the  past. 

In  the  definition  of  games  with  awareness,  we  allow  Q  to  contain  augmented  games  based  on 
standard  games  different  from  the  game  on  which  Tm,  the  modeler’s  game,  is  based.  We  continue 
to  require  conditions  Cl,  C3-C5,  C7-C9,  and  Cll,  but  we  weaken  C2.  In  C2  we  required  that 
a  player  i  cannot  consider  possible  a  game  where  one  of  the  players  j  moving  in  is  aware 
of  more  runs  than  i  is.  In  this  setting,  we  allow  i  to  consider  possible  a  game  I'7  where  one  of 
the  players  j  moving  in  I’7  believes  (falsely,  from  V s  point  of  view)  that  some  runs  arc  possible 
that  i  does  not  consider  possible.  However,  we  require  that  the  set  of  moves  that  i  believes  that  j 
believes  arc  available  to  him  while  moving  at  history  h'  in  k7  is  a  subset  of  the  moves  i  believes 
arc  available  to  j  while  moving  at  h' .  We  thus  replace  C2  by  the  following  condition  C2",  which 
is  the  analogue  of  parts  (b)  and  (c)  of  C2'. 

C2".  If  ti  G  Hh,  Ph(h')  =  j,  and  P(Th,  ti)  =  (F,  I'),  then  for  all  h"  G  M'h„  C  Mfr,  and 
fl  {m  :  hi  ■  (m)  G  a}  =  Mfy. 

Since  we  allow  players  to  have  false  beliefs  about  information  sets,  we  drop  conditions  C6  and 
CIO.  However,  since  we  have  dropped  A7  and  weakened  C2,  we  now  need  the  following  condi¬ 
tion,  which  requires  that  if  a  player  considers  possible  a  set  of  histories  of  the  underlying  game, 
then  he  cannot  believe  that  in  the  future  he  will  consider  possible  a  different  set  of  histories.7 

C12.  If  b!  G  I,  h"  G  Hh,  Ph(h")  =  i,  and  h"  is  a  suffix  of  h' ,  then  A^(h')  =  A^(h"). 

'  Note  that  this  does  not  rule  out  a  situation  where  a  player  i  realizes  at  history  h!  that  his  view  of  the  game  will  change  at 
a  future  history  h"  when  he  receives  some  additional  information.  If  this  is  the  case,  then  this  should  already  be  described  in 
the  set  of  histories  that  i  considers  possible  at  h! . 
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It  is  easy  to  see  what  C12  follows  from  A7,  C2,  and  C4,  which  is  why  we  did  not  list  it  explicitly 


earlier. 

This  approach  of  allowing  the  augmented  games  in  Q  to  be  based  on  different  underlying  games 
actually  subsumes  our  earlier  approach  and  allows  us  to  capture  lack  of  common  knowledge 
about  who  moves,  what  the  information  sets  arc,  and  what  the  payoffs  arc.  For  example,  note  that 
despite  the  fact  that  we  have  replaced  A3-5  by  Ml -3,  we  can  also  model  games  with  awareness 
using  this  approach  by  taking  the  game  T(h)  to  be  the  game  consisting  only  of  the  runs  of  I' 
that  are  in  A+(h).  (Of  course,  if  we  do  that,  we  need  to  reinstate  A7  and  replace  C2"  with 
C2.)  To  capture  lack  of  common  knowledge  about  who  moves,  we  take  T(/i)  to  be  identical  to  T 
except  that  different  agents  may  move  at  a  given  information  set.  Similarly,  we  can  model  lack  of 
common  knowledge  about  what  the  information  sets  and  what  the  payoffs  are  by  restricting  T(/t) 
appropriately. 

Despite  all  the  changes  to  the  conditions,  the  definitions  of  local  strategies  and  generalized  Nash 
equilibrium,  and  the  theorems  and  their  proofs  remain  unchanged.  Thus,  our  techniques  can  deal  with 
highly  subjective  games  as  well  as  awareness. 

6  Related  Work 

There  have  been  a  number  of  models  for  unaware  ness  in  the  literature  (see,  for  example,  [2;  14;  20;  21; 
1]).  Halpern  [8]  and  Halpern  and  Rego  [10]  showed  that  in  a  precise  sense  all  those  models  are  special 
cases  of  Fagin  and  Halpern’s  [2]  approach  where  they  modeled  awareness  syntactically  by  introducing 
a  new  modal  operator  for  it.  Halpern  and  Rego  [11]  extended  Fagin  and  Halpern’s  logic  of  awareness 
to  deal  with  knowledge  of  unawareness.  All  of  these  papers  focused  on  logic,  and  did  not  analyze  the 
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impact  of  unawareness  in  a  strategic  setting. 


Feinberg’s  [3,  4]  work  is  most  similar  work  to  ours.  We  discussed  the  high-level  difference  be¬ 
tween  our  work  and  that  of  Feinberg  in  the  introduction.  Here  we  focus  on  some  of  the  more  detailed 
differences: 

•  Feinberg  does  not  model  games  semantically.  He  encodes  all  the  information  in  the  T  function 
syntactically,  by  describing  each  player’s  awareness  level  and  iterated  nested  awareness  levels 
(e.g.,  what  player  1  is  aware  that  player  2  is  aware  that  player  3  is  aware  of). 

•  In  dealing  with  extensive  games,  Feinberg  [3]  assumes  that  the  runs  that  a  player  is  aware  of 
completely  determine  what  game  he  believes  he  is  playing.  It  cannot  be  the  case  that  there  arc 
two  distinct  “identities”  of  a  player  that  have  the  same  awareness  level.  As  we  discussed  in 
Section  2,  this  assumption  limits  the  applicability  of  the  model. 

•  Feinberg  assumes  that  if  player  i  is  aw  are  of  player  j,  then  i  must  be  aw  are  of  some  move  of  player 
j.  We  do  not  require  such  a  condition  since  the  analogous  condition  is  not  typically  assumed  in 
standard  extensive  games.  For  example,  in  a  standard  extensive  game,  a  player  may  get  a  payoff 
even  though  there  is  no  node  where  he  can  move.  But  it  is  trivial  to  add  this  requirement  (as  it 
would  be  trivial  to  drop  in  Feinberg’s  framework),  and  making  it  has  no  impact  on  the  results. 

•  Feinberg  [4]  defines  payoffs  for  player  i  by  using  what  he  calls  “default  actions”  for  players  that 
i  is  unaware  of.  He  says  that  this  default  action  will  be  context  dependent.  We  do  not  have  such 
default  actions  in  our  setting;  the  payoff  of  a  player  in  our  framework  is  independent  of  the  payoff 
of  the  players  he  is  unaw  are  of.  The  assumption  of  a  default  action  seems  somewhat  problematic 
to  us;  it  is  not  clear  what  the  default  move  should  be  in  general.  Moreover,  if  two  different  players 
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arc  unaware  of  player  j,  it  is  not  clear  why  (or  whether)  they  should  assume  the  same  default 


action. 


•  In  dealing  with  extensive  games,  Feinberg  [3]  defines  moves  of  nature  by  conditioning  on  the  set 
of  moves  of  nature  the  player  is  aware  of.  In  our  framework,  this  would  amount  to  the  following 
requirement: 


C13  If  T+  G  g,  h  G  H+,  P+{h)  =  i,  Af  (h)  =  a,  T(T+,  h) 


C Th,I ),  h!  G  Hh,  Ph(ti)  =  c. 


and  M%,  n  M-g  /  0,  then  \  h!) 


fc(m\hj  por  every  m  g  and  fr(m  I  h')  =  0 


if  m  £  Mfy . 


As  Feinberg  did,  for  that  condition  to  be  well  defined  we  require  that  fc{m  h)  ^  0  for  all 
m  G  M-r  and  histories  h.  As  we  discussed  in  Section  2,  while  we  believe  such  a  requirement 
makes  sense  if  nature’s  move  is  interpreted  objectively,  it  does  not  make  sense  in  general  so  we 
do  not  assume  this  in  every  augmented  game. 


Sadzik  [26]  considers  a  logic  of  awareness,  knowledge,  and  probability  based  on  that  of  Heifetz, 
Meier,  and  Schipper  [14],  and  uses  it  to  give  a  definition  of  Bayesian  equilibrium  in  normal-form 
games  with  awareness.  Heifetz,  Meier  and  Schipper  [13]  also  consider  a  generalized  state-space  model 
with  interactive  unawareness  and  probabilistic  beliefs  and  give  a  definition  of  Bayesian  equilibrium  in 
normal-form  games,  without  assuming  Feinberg’s  restriction.  Li  [17]  has  also  provided  a  model  of  un¬ 
awareness  in  extensive  games,  based  on  her  earlier  work  on  modeling  unawareness  [18;  19].  Although 
her  representation  of  a  game  with  unawareness  is  quite  similar  to  ours,  her  notion  of  generalized  Nash 
equilibrium  is  different  from  ours.  Just  as  we  do,  she  requires  that  every  player  i  make  a  best  response 
with  respect  to  his  beliefs  regarding  other  player’s  strategies  in  the  game  T'  that  i  considers  possible. 
However,  unlike  us,  she  requires  that  these  beliefs  satisfy  a  consistency  requirement  that  implies,  for 


35 


example,  that  if  a  player  i  is  aware  of  the  same  set  of  moves  for  him  at  both  information  set  I\  in  game 


F  |  and  information  set  I2  in  F^,  and  these  information  sets  coiTespond  to  the  same  information  set  in 
the  underlying  game  F.  then  the  local  strategies  and  cr,:  p2  must  agree  at  these  information  sets;  that 
is,  o-^nUi)  =  <*i, v2{h)- 

Ozbay  [23]  proposes  a  model  for  games  with  uncertainty  where  players  may  have  different  aware¬ 
ness  levels  regarding  a  move  of  nature.  He  assumes  that  one  of  the  players  is  fully  aw  are,  and  can  tell 
the  other  player  about  these  moves  before  the  second  player  moves.  Although  our  model  can  easily 
capture  this  setting,  what  is  interesting  about  Ozbay ’s  approach  is  that  the  second  player’s  beliefs  about 
the  probability  of  these  revealed  moves  of  arc  formed  as  paid  of  the  equilibrium  definition.  Filiz  [5]  uses 
Ozbay’s  model  in  the  context  of  incomplete  contracts  in  the  presence  of  unforseen  contingencies.  In  this 
setting,  the  insurer  is  assumed  to  be  fully  aw  are  of  the  contingencies,  and  to  decide  strategically  which 
contingencies  to  include  in  a  contract,  while  the  insuree  may  not  be  aw  are  of  all  possible  contingencies. 

Finally,  we  remark  that  our  notion  of  a  game  with  awareness  as  consisting  of  the  modeler’s  game 
together  with  description  of  which  game  each  agent  thinks  is  the  actual  game  at  each  history  has  much 
in  common  with  the  intuition  behind  Gal  and  Pfeffer’s  [6]  notion  of  a  Network  of  Influence  Diagrams 
(NID).  Formally,  NIDs  arc  a  graphical  language  for  representing  uncertainty  over  decision-making  mod¬ 
els.  A  node  in  a  NID  (called  a  block  by  Gal  and  Pfeffer)  represents  an  agent’s  subjective  belief  about 
the  underlying  game  and  what  the  strategies  used  by  agents  depend  on.  Each  node  (game)  in  a  NID  is 
associated  with  a  multiagent  influence  diagram  [15]  (MAID),  which  is  a  compact  representation  of  a 
game.  A  NID  has  directed  edges  between  nodes  labeled  by  pairs  of  the  form  (*,  H),  where  i  is  an  agent 
and  (in  our  language)  H  is  a  set  of  histories.  Intuitively,  if  there  an  edges  from  a  node  (game)  F  to  a 
node  T'  in  a  NID  labeled  by  a  pair  ( i ,  H ) ,  then  H  is  a  set  a  set  of  histories  in  F.  there  is  an  agent  j  that 
moves  at  all  the  histories  in  H ,  and  in  game  T,  i  believes  that  j  believes  that  T'  is  the  true  game  when 
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moving  at  a  history  h  €  //. 


Although  Gal  and  Pfeffer  do  not  tty  to  handle  notions  of  awareness  with  NIDs,  it  seems  possible  to 
extend  them  to  handle  awareness.  To  do  this  appropriately,  consistency  requirements  similar  to  C1-C10 
will  need  to  be  imposed. 

7  Conclusion 

We  have  generalized  the  representation  of  games  to  take  into  account  agents  who  may  not  be  aware 
of  all  the  moves  or  all  the  other  agents,  but  may  be  aware  of  their  lack  of  awareness.  Moreover, 
our  representation  is  also  flexible  enough  to  deal  with  subjective  games  when  there  is  lack  of  common 
knowledge  about  the  game,  even  if  awareness  is  not  an  issue.  We  have  also  shown  how  to  define 
strategies  and  Nash  equilibrium  in  such  settings.  These  generalizations  greatly  increase  the  applicability 
of  game-theoretic  notions  in  multiagent  systems.  In  large  games  involving  many  agents,  agents  will 
almost  certainly  not  be  aware  of  all  agents  and  may  well  not  be  aware  of  all  the  moves  that  agents  can 
make.  Moreover,  as  we  suggested  in  the  introduction,  even  in  well-understood  games  like  chess,  by 
giving  awareness  a  more  computational  interpretation,  we  can  provide  a  more  realistic  model  of  the 
game  from  the  agents’  perspective.  We  remark  that  although  we  focus  on  generalizing  extensive-form 
games,  our  framework  is  able  to  deal  with  normal-form  games  as  well,  since  we  can  view  normal-form 
games  as  a  special  case  of  extensive-form  games. 

There  is  clearly  much  more  to  be  done  to  understand  the  role  of  awareness  (and  lack  of  awareness) 
in  multiagent  systems.  We  list  some  of  the  many  issues  here: 

•  We  have  assumed  perfect  recall  here.  But  in  long  games,  it  seems  more  reasonable  to  assume  that 
agents  do  not  have  perfect  recall.  In  a  long  chess  game,  typical  players  certainly  do  not  remember 
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all  the  moves  that  have  been  played  and  the  order  in  which  they  were  played.  It  is  well  known 


that  even  in  single-agent  games,  considering  agents  with  imperfect  recall  leads  to  a  number  of 
subtleties  (c.f.  [7;  24]).  We  suspect  that  yet  more  subtleties  will  arise  when  combining  imperfect 
recall  with  lack  of  awareness. 

•  In  a  Nash  equilibrium  of  an  extensive-form  game,  it  may  be  the  case  that  the  move  made  at 
an  information  set  is  not  necessarily  a  best  response  if  that  information  set  is  not  reached.  For 
example,  in  the  game  described  in  Figure  1 ,  even  if  both  players  have  common  knowledge  of  the 
game,  the  profile  where  A  moves  down  and  B  moves  across  is  a  Nash  equilibrium.  Nevertheless 
moving  down  is  not  a  best  response  for  B  if  B  is  actually  called  upon  to  play.  The  only  reason  that 
this  is  a  Nash  equilibrium  is  that  B  does  not  in  fact  play.  Sequential  equilibrium  [16]  is  a  solution 
concept  that  is  arguably  more  appropriate  for  an  extensive-form  game;  it  refines  Nash  equilibrium 
(in  the  sense  that  every  sequential  equilibrium  is  a  Nash  equilibrium)  and  does  not  allow  solutions 
such  as  (downer,  across#).  Our  representation  of  games  with  awareness  (of  unaware  ness)  allows 
for  relatively  straightforward  generalizations  of  such  refinements  of  Nash  equilibrium.  However, 
there  arc  subtleties  involved  in  showing  that  generalized  versions  of  these  refinements  always 
exist.  For  example,  we  no  longer  have  a  one-to-one  correspondence  between  the  generalized 
sequential  equilibria  of  the  game  T*  and  the  sequential  equilibria  of  the  corresponding  standard 
game  Tu.  Nevertheless,  we  believe  that  we  should  be  able  to  use  a  more  refined  construction  to 
show  that  a  generalized  sequential  equilibrium  exists  in  every  game  with  awareness. 

•  We  have  analyzed  situations  where  agents  may  be  unaw  are  of  some  moves  in  the  underlying  game, 
may  be  aware  of  their  unaw  areness,  and  may  have  completely  false  beliefs  about  the  underlying 
game.  Of  course,  there  arc  other  cases  of  interest  where  additional  properties  may  hold.  For 


38 


example,  consider  a  large  geographically-dispersed  game  where  agents  interact  only  with  nearby 


neighbors.  In  such  a  game,  an  agent  may  be  unaware  of  exactly  who  is  playing  the  game  (although 
she  may  realize  that  there  arc  other  agents  besides  her  neighbors,  and  even  realize  that  the  moves 
made  by  distant  agents  may  have  an  indirect  effect  on  her).  To  model  such  a  situation,  we  may 
want  to  have  virtual  moves  after  which  the  game  does  not  end,  and  to  allow  agents  to  be  aware  of 
subsequences  of  histories  in  the  underlying  game.  We  suspect  that  a  straightforward  extension  of 
the  ideas  in  this  paper  can  deal  with  such  situations,  but  we  have  not  worked  out  the  details. 

•  There  has  been  a  great  deal  of  work  on  computing  Nash  equilibria.  As  we  have  shown,  a  gen¬ 
eralized  Nash  equilibrium  of  a  game  with  awareness  is  a  Nash  equilibrium  of  a  standard  game. 
However,  this  standard  game  can  be  rather  large.  Are  there  efficient  computational  techniques  for 
computing  generalized  Nash  equilibrium  in  interesting  special  cases? 

•  If  there  is  little  shared  knowledge  regarding  the  underlying  game,  the  set  Q  of  augmented  games 
can  be  quite  large,  or  even  infinite.  Is  it  important  to  consider  all  the  iterated  levels  of  unaware¬ 
ness  encoded  in  Q1  Halpern  and  Moses  [9]  showed  that,  in  analyzing  coordinated  attack,  no 
finite  level  of  knowledge  suffices;  common  knowledge  is  needed  for  coordination.  Stopping  at 
any  finite  level  has  major  implications.  Rubinstein  [25]  considered  a  valiant  of  the  coordinated 
attack  problem  with  probabilities,  and  again  showed  that  no  finite  level  suffices  (and  significant 
qualitative  differences  arise  if  only  a  finite  paid  of  hierarchy  of  knowledge  is  considered).  On  the 
other  hand,  Weinstein  and  Yildiz  [28]  provide  a  condition  under  which  the  effect  of  players’  kill 
order  beliefs  is  exponentially  decreasing  in  k.  While  we  strongly  suspect  that  there  arc  games 
in  which  higher-order  unaware  ness  will  be  quite  relevant,  just  as  with  the  Weinstein- Yildiz  re¬ 
sult,  there  may  be  conditions  under  which  higher-order  awareness  becomes  less  important,  and 
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a  simpler  representation  may  suffice.  Moreover,  it  may  be  possible  to  use  NIDs  to  provide  a 


more  compact  representation  of  games  of  awareness  in  many  cases  of  interest  (just  as  Bayesian 
networks  provide  a  compact  representation  of  probability  distributions  in  many  cases  of  interest), 
leading  to  more  efficient  techniques  for  computing  generalized  Nash  equilibrium. 

We  hope  to  explore  some  of  these  issues  in  forthcoming  work. 
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A  Proofs 

Theorem  3.1:  For  all  probability  measures  v  on  Q 

(a)  Tu  is  a  standard  extensive  game  with  perfect  recall; 

(b)  if  v  gives  positive  probability  to  all  games  in  Q,  then  o  is  a  Nash  equilibrium  of  V'  iff  o'  is  a 
generalized  Nash  equilibrium  ofT*,  where  Oiyr((Th)  •  If)  =  a .•  r,(rft,  h'). 
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Proof:  For  part  (a),  suppose  that  (Y'}  •  h\ )  and  (Y")  •  h'[)  arc  in  the  same  (i,  T+) -information  set  of 
r"  and  that  h'2  is  a  prefix  of  h\  such  that  Pu(( Y')h2))  =  (*,  T+).  By  definition  of  Yv ,  it  must  be  the 
case  that  there  exist  information  sets  I\  and  I2  in  F  such  that  P(Y' .  h\ )  =  T ( Y" ,  h!( )  =  ( Y+,Ii ) 
and  P(Y',  h'2 )  =  (r+,  I2 ).  If  h\  is  a  history  in  I\,  C8  implies  that  there  exists  a  prefix  h2  of  hi  such 
that  P+(/i2)  =  i,  P(Y+,h2)  =  ( r+,/2 )  and  if  h2  ■  ( m }  is  a  prefix  of  h\ ,  then  h‘2  ■  (m)  is  a  prefix 
of  hi.  Applying  C8  again,  it  follows  that  there  exists  a  prefix  h2  of  h”  such  that  Pl" (h2)  =  i  and 
P(Y",  h2)  =  (r+,/2)  and  if  /12  •  (m)  is  a  prefix  of  hi,  then  h2  ■  (m)  is  a  prefix  of  h'(.  Therefore,  by 
definition  of  Yu ,  (T".  h2)  and  fFF  h2)  arc  in  the  same  information  set. 

Suppose  further  that  h2  ■  (m)  is  a  prefix  of  h\ .  Thus,  /12  •  (m)  is  a  prefix  of  hi,  which  implies  that 
h2  ■  (m)  is  a  prefix  of  h'[.  This  proves  paid  (a). 

For  paid  (b),  let  Prh  be  the  probability  distribution  over  the  runs  in  Yu  induced  by  the  strategy  profile 
<7  and  f'h  Pr'i(z)  is  the  product  of  the  probability  of  each  of  the  moves  in  z.  (It  is  easy  to  define  this 
formally  by  induction  on  the  length  of  z\  we  omit  details  here.)  Similarly,  let  Prh,  be  the  probability 
distribution  over  the  runs  in  Yh  €  Q  induced  by  the  generalized  strategy  profile  o'  and  fjh.  Note  that  if 
Prh,  (z)  >  0,  then  2  G  [Hh\.  Thus,  (Yh)  -  z£Hu. 

For  all  strategy  profiles  o  and  generalized  strategy  profiles  o',  if  o\  r,  (1^' ,  h!)  =  rTI  p/((r/'  )  •/;/),  then 
it  is  easy  to  see  that  for  all  z  £  Zh  such  that  Prh,  (z)  >  0,  we  have  that  Prg((Yh)  ■  z)  =  v(Yh)Prg,(z). 
And  since  u  is  a  probability  measure  such  that  u(Yh  )  >  0  for  all  G  Q,  we  have  that  Pr^((Yh)  ■  z)  >  0 
iff  Prgi(z)  >  0.  Suppose  that  o  is  a  Nash  equilibrium  of  Yu .  Suppose,  by  way  of  contradiction,  that  o' 
such  that  o'{  r,  (I^'.  h!)  =  71x/((r/')  •  h!)  is  not  a  generalized  Nash  equilibrium  of  F*.  Thus,  there  exists 
a  player  i,  a  game  F+  G  Gi,  and  a  local  strategy  s'  for  player  i  in  F  !  such  that 
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E  Prff'(z)ut(z)  <  X  PrP  Az)ut(z)- 

z&z+  2ez+  -(i’r+)’ 


(1) 


Define  s  to  be  a  strategy  for  player  ( i ,  T+)  in  T"  such  that  s((Th)  ■  h ')  =  s'(Th,  h').  Multiplying  (1) 
by  i/(r+)  and  using  the  observation  in  the  previous  paragraph,  it  follows  that 
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PrvAF+)-z] 
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(2) 


By  definition  of  u” r,,  (2)  holds  iff 


E  p^Kr^)<  E  r+), .)(2"K r+  un 


(3) 


Zv<zZv  Zv<zZv 

Therefore,  <r  is  not  a  Nash  equilibrium  of  TE  a  contradiction.  The  proof  of  the  converse  is  similar; 
we  leave  details  to  the  reader.  | 


Corollary  3.1:  Every  game  with  awareness  has  a  generalized  Nash  equilibrium. 

Proof:  For  games  with  perfect  recall,  there  is  a  natural  isomorphism  between  mixed  strategies  and 
behavioral  strategies,  so  a  Nash  equilibrium  in  behavior  strategies  can  be  viewed  as  a  Nash  equilibrium 
in  mixed  strategies  [22].  Moreover,  mixed-strategy  Nash  equilibria  of  an  extensive-form  game  arc  the 
same  as  the  mixed-strategy  Nash  equilibria  of  its  normal-form  representation.  Salonen  [27]  showed  that 
there  exists  a  Nash  equilibrium  in  mixed  strategics  in  a  normal  form  games  with  an  arbitrary  set  N  of 
players  if,  for  each  player  i,  the  set  St  of  pure  strategies  of  player  i  is  a  compact  metric  space,  and 
the  utility  functions  m  :  S  —>  JR  are  continuous  for  all  i  €  N,  where  1R  is  the  set  of  real  numbers 
and  S  =  IljgjvSi,  the  set  of  pure  strategies,  is  endowed  with  the  product  topology.  Since  in  I’E  every 
player  has  a  finite  number  of  pure  strategies,  Si  is  clearly  a  compact  metric  space.  Moreover,  since  each 
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player’s  utility  depends  only  on  the  strategies  of  a  finite  number  of  other  players,  it  is  easy  to  see  that 


Ui  :  S  — >  1R  is  continuous  for  each  player  i  €  N.  It  follows  that  there  exists  a  Nash  equilibrium  of  Tu . 
Thus,  the  corollary  is  immediate  from  Theorem  3.1.  | 
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